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1- Theoretical discussion : 

The problem is to track the ration of part of a field of view. Lot 
us assume that the scene is a two-dimensional picture in a plane perpen- 
dicular to the roll axis. (These simplifying assumptions, of course, are 
a main problem in estimating how the system works in real life)- So we 
can think of the picture as a function f(x,y) in some plane. 

Now suppose that at time t the scene is f-(x,y) and at some time 
later it has moved, and is f t (x,y). Suppose also that the scene has not 
changed, but has only been moved rigidly in the plane. Then an elegant 
mathematical way to estimate this motion is to compute the cross-correlation 
of the original and current picture. First let us review a basic simple 
aathematical fact* Given any function f(x) and any displacement A> it is 
true that 

/ f(x) f(x) * / f(x) f(x +4) 



(when the expressions are meaningful) &nd we have > rather than * 
except under the most peculiar conditions, i.e., when the pattern is 
perfectly periodic. (This fact is a consequence of the triangle inequality 
a^ + b* > c , slightly generalized). In fact, if one considers 

i (u) - /f (x) f (x + A) 

one always gets a graph like 




with its maximum at and symmetrical on both sides- Now, consider some 
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small number d, called the "delay", and consider the formula 

g(h) » /£ f<x + d> - f(x - d) 1 f(x + h) 

If we look at the values of this for various values of h, we find: 

g<d) - /f(x + d) f(x * d) - /f<x - d) f{x + d) - *(o) - 4(2d) >0 

g(o) - /f(x + d) f(x) - /£<x - d) f(x) = $(d> - $(d ) - 

g(-d) - /f(x + d) f(x - d) - /f<x - d) f{x - d) = $(2d) - ,<o) <0 

(because ;£(x + a) f(x + a + b) - /f{x) f(x + b> in general). 

and assuming everything is nice and smooth, ue can expect to get a curve 
like this; 




yielding a "discrimination curve" which is just what we want, because in 
the "linear" range it computes the displacement of £(>:) from f{x+h) for us! 
Now it is of practical importance for us to know how large is the "linear" 
range because 

(1) it tells us how large a step a device could cope with and 

(2) it incidentally tells us how accurate or coarse the computation 
of the integrals must be - this bears on the size of optical 
slit - or whatever is used in practice. 

Now we can find a lot about this by (theoretically) considering a very 
snail displacement d - in fact, if d is allowed to go to zero* we get a 

sort of differential analysis: we divide by d to keep things from blowing 
up, and we get: 
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J /[ f (x + d) - f (x - d)] f (x + h) 

- 2 '<*+■») -f(x-d) f {x + h) 

* 2d 



- 2 / f (x) £<x + h) 

- 2 V 00 

by sone analysis Involving djM . , £ - (x)f(x + h) + ^ (x)f{x + ^ 
and the fact that p(h) - M~h). 



This says that as the delay d goes to zero, the "discrimination curve" 
approaches the derivative of the auto-correlation function j (h) 




and this suggests that there is no serious risk if we take d to be of th< 
order o£ h the width of the main peak of the auto-correlation function. 
In terms of the picture-function £(x*y)» this width is a measure of the 
"grain" of the scene-texture; it is probably the most important ("first- 
order") parameter for characterizing scenes in terms suitable for 
correlation-based instruments. 

What is the Intuitive significance of the tracking function? 

J-f'Cx) f(x + h> - *'(h) 



Two simple examples show what is happening: 
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1. f(x) - 
f'(x) - 



A 



so if h Is positive, or negative we get 



- + 





and here, for a square wave, we get simply the sign of the displacement! 
on the other hand, 

2- f(x> - 




f(x) - 



h positive 



h negative 



.JtfTK-.. 



+ 






and ve get something more proportional to the anount of the displacement. 
Under the assumption that the lengths of regions of positive and negative 
derivatives are generally equal, we can approximate this "analogue" 
situation by differentiating and "clipping" the results; the error in 
this depends very much on the situation and sometimes the "digitized" 
result will be better, usually worse, than the analogue. 

2. Polar coordinates and axial tracking . 

w 

Now let us consider a more practical situation; we consider the 
problen of tracking, still with the same assumptions, but assuming the 
scene 1$ on a sphere so that we want to compute pitch, yaw, and roll. 
Sow let us replace f(x,y) by F(r,0) and consider a polar integral 
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2tr 
; K(r) / Q(r,6) J(6) d 6dr 
o o 

where K and J are "hardware" functions we have to consider. Suppose 

first chat J(3) = 1 and K(r) falls off fast enough to make the integral 

converge (that is, a "finite radial angle shaded slit." The slit width 

is concealed in the rest of the mathematics). Then if the scene is 

simply rotated, we use for Q(r,9) 

Q(r, 6) - F 1 (r t 0) F(r,6 4*) 

and this gives us an estimate of the phase, CC , Just as in the first 
section. 

If the scene suffers a ^translation, in pitch or yaw, the effect 
on this averages out to 2ero because we get opposite effects in each 
henisphere; 



\ 




but this is a statistical cancellation and is an error that must be 
reckoned on! Thus there will be "cross talk" if the picture is not 
symmetric, in a suitable average sense. 

Now, to get the yaw-component, we use J($) * sine and get the effects 
above to addE 

i I ) \ + (advance) sin £ - + 
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- (retard) sin r is * + 



In this case the contribution of the pitch component averages to zero 
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because for it we get cos (8) ■ J(6): 

+ (advance) cos(t) ■ + 
- (retard) cos (-7) - - 

and these cancel. 

Thus ic is possible to resolve the three components roll (J(S) ■ 1), 
pitch, (J<8) - cos 9), and yaw (J (e) « sin 6) by changing the "kernel" 
of the integral. One could even approximate this digitally by using 



cos e * 

sin 8 2 



i=R- 



as approximations, but this vould increase the "cross talk." 

3. The Assumptions 

It remains zo discuss the assumptions; 

1, Stereo changes mean that throughout, we never really have 

f (x + h) 
but we always have a new picture 
g(x + h) & f (x + h) + error 

2. It is safe to say that because the situation is real, there is 
no trouble with the analytic mathematics. One has to worry only 
about the photon and other noise involved in empirical evaluation 
of the integrals and derivatives. 

3- Although the auto-correlation function is always symmetrical 

/£<x) f<x + h) - /f(x) f(x - h> 

this is only approximately true for a n*v scene 

/g{ac) f(x + h) i /g(x) f(x - h) 
ami a systematic drift during a changing scene could cause a 
cumulative error. 
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4. .The most serious problem is: To vhat extent will a theoretical 
calculation based on a good smooth, convex maximum of auto- 
correlation function be realistic? It will be valuable in 
calculating the underlying basic random-variable drift of the 
system, but this theory has to be supplemented by a special- 
case analysis of the worst "deterministic" patterns known or 
suspected to cause trouble. 

We should do so^e experiments using correlation on very simple 
arrays. Even, say, 16 points around a circle should yield interesting 
results 1 



